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1 
SYSTEMS AND METHODS FOR 
AUTOMATED VESSEL NAVIGATION USING 
SEA STATE PREDICTION 


RELATED APPLICATIONS 


This application is a divisional application to U.S. patent 
application Ser. No. 13/161,425 filed Jun. 15, 2011. This 
application and U.S. patent application Ser. No. 13/161,425 
filed Jun. 15, 2011 claim priority to U.S. Provisional Appli- 
cation 61/355,064 filed Jun. 15, 2010 and US. Provisional 
Application 61/474,839 filed Apr. 13, 2011, the disclosures 
of which are incorporated herein by reference. 


STATEMENT OF FEDERAL SUPPORT 


The invention described herein was made in the perfor- 
mance of work under a NASA contract, and is subject to the 
provisions of Public Law 96-517 (35 U.S.C. §202) in which 
the Contractor has elected to retain title. 


FIELD OF THE INVENTION 


The present invention is generally related to sea state 
prediction and automated vessel navigation, and more spe- 
cifically to sea state prediction by detecting wave fronts and 
automated vessel navigation based upon main wave direc- 
tion. 


BACKGROUND 


Vessel navigation on fluid surfaces such as the sea can be 
more difficult than vehicle navigation on rigid surfaces such 
as on land. Waves on fluid surfaces apply significant force to 
vessels, in particular when such vessels are moving with 
high speeds in severe sea conditions. Severe sea conditions 
are sea conditions with significant wave activity. Severe sea 
conditions can be acutely felt in littoral operations, or 
operations close to shore, where the shallow water and 
underwater geography can create significant wave lengths 
and speeds. Vessels that can command high speeds or that 
are of a small mass are especially vulnerable to damage from 
severe sea conditions. This damage caused by kinetic wave 
energy includes crew injuries, capsizing, bow diving or 
other damage to the vessel. Furthermore, waves can slow a 
vessel down from reaching its target destination. Severe sea 
conditions are not limited to conditions at sea but can apply 
to conditions on any body of water including fresh or salt 
water as well as an ocean, lake or river. 

The difficulty of navigating a vessel in severe sea condi- 
tions is further compounded for autonomous vessel naviga- 
tion. Difficulty can arise where vessel navigation depends 
upon the limited resources of machine sensory equipment 
and processing to navigate the vessel. 


SUMMARY OF THE INVENTION 


Systems and methods in accordance with embodiments of 
the invention perform sea state prediction and/or autono- 
mous navigation. One embodiment of the invention includes 
a method of predicting a future sea state including generat- 
ing a sequence of at least two 3D images of a sea surface 
using at least two image sensors, detecting peaks and 
troughs in the 3D images using a processor, identifying at 
least one wavefront in each 3D image based upon the 
detected peaks and troughs using the processor, character- 
izing at least one propagating wave based upon the propa- 
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gation of wavefronts detected in the sequence of 3D images 
using the processor, and predicting a future sea state using 
the at least one propagating wave characterizing the propa- 
gation of wavefronts in the sequence of 3D images using the 
processor. 

Ina further embodiment, generating a sequence of at least 
two 3D images of a sea surface uses two pairs of image 
sensors. 

In another embodiment, generating a sequence of at least 
two 3D images of a sea surface also includes using a radar 
sensor in combination with the at least two image sensors. 

In a still further embodiment, images sensors capture 
black and white images. 

In a still another embodiment, image sensors capture 
color images. 

In a yet further embodiment, detecting peaks and troughs 
includes using a random sampling process. 

Ina yet another embodiment, detecting peaks and troughs 
includes using a least means squares process. 

In a further embodiment again, detecting peaks and 
troughs includes using a thresholding process. 

In another embodiment again, identifying at least one 
wavefront includes using a nearest neighbor process. 

Ina further additional embodiment, characterizing at least 
one propagating wave includes determining the amplitude, 
frequency and velocity of at least one propagating wave. 

In another additional embodiment, characterizing at least 
one propagating wave includes determining the direction of 
at least one propagating wave. 

In a still yet further embodiment, characterizing at least 
one propagating wave includes determining the wave phase 
of at least one propagating wave. 

A still yet another embodiment further includes autono- 
mously navigating a vessel based upon a predicted future sea 
state. 

A still yet another embodiment includes a method of 
autonomous vessel navigation based upon a predicted sea 
state and target location, including determining at least one 
subtarget based upon target location and predicted sea state 
using a macronavigation system, communicating at least one 
subtarget to the micronavigation system, and controlling a 
vessel to navigate toward at least one subtarget using a 
micronavigation system. 

In a still further embodiment again, a predicted sea state 
includes a main wave direction. 

In still another embodiment again, a predicted sea state 
includes a wave phase information. 

In a still further additional embodiment, a subtarget is the 
target location. 

In still another additional embodiment, a micronavigation 
system includes a proportional integral derivative controller. 

In a yet further embodiment again, navigating toward at 
least one subtarget causes the vessel to tack relative to a 
main wave direction. 

In a yet another embodiment again, a subtarget causes the 
vessel to navigate at 60 degrees relative to the main wave 
direction. 

In a yet further additional embodiment, controlling the 
vessel includes controlling the throttle and the rudder of the 
vessel. 

In a yet another additional embodiment, a predicted sea 
state is predicted using at least one propagating wave 
characterizing propagation of wavefronts from detected 
peaks and troughs in a sequence of 3D images. 

A further additional embodiment again includes a system 
for predicting a future sea state including a sensor system 
configured to capture information concerning the shape of 
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the sea surface, a sea state processor configured to commu- 
nicate with a sensor system, wherein the sensor system and 
the sea state processor are configured so that captured 
information is used to generate a sequence of 3D images of 
a sea surface, wherein the sea state processor is configured 
to detect peaks and troughs in the 3D images, identify at 
least one wavefront in each 3D image based upon the 
detected peaks and troughs, characterize at least one propa- 
gating wave based upon the propagation of wavefronts 
detected in the sequence of 3D images using the processor, 
and predict a future sea state using at least one propagating 
wave characterizing the propagation of wavefronts in the 
sequence of 3D images using the processor. 

In another additional embodiment again, a sensor system 
includes two pairs of image sensors. 

In another further embodiment again, a sensor system 
includes a radar sensor. 

In another further embodiment, a sensor system and a sea 
state processor are configured so that captured information 
is used to generate a sequence of black and white 3D images 
of a sea surface. 

In still another further embodiment, a sensor system and 
a sea state processor are configured so that captured infor- 
mation is used to generate a sequence of color 3D images of 
a sea surface. 

In yet another further embodiment, a sea state processor 
is configured to detect peaks and troughs using a random 
sampling process. 

In another further embodiment again, a sea state processor 
is configured to detect peaks and troughs using a least means 
squares process. 

In another further additional embodiment, a sea state 
processor is configured to detect peaks and troughs using a 
thresholding process. 

In still yet another further embodiment, a sea state pro- 
cessor is configured to identify at least one wavefront using 
a nearest neighbor process. 

In another yet additional embodiment, a sea state proces- 
sor is configured to characterize at least one propagating 
wave by the amplitude, frequency and velocity of the at least 
one propagating wave. 

In another yet further embodiment, a sea state processor 
is configured to characterize at least one propagating wave 
by the direction of the at least one propagating wave. 

In another yet additional embodiment again, a sea state 
processor is configured to characterize at least one propa- 
gating wave by the wave phase of the at least one propa- 
gating wave. 

Another yet further embodiment again includes an 
autonomous vessel navigation system that utilizes the pre- 
dicted future sea state to determine vessel heading when 
navigating toward a target. 

A further embodiment includes an autonomous vessel 
navigation system, including a macronavigation system con- 
figured to receive a predicted sea state and a target as inputs 
and to generate a subtarget as an output, and a micronavi- 
gation system configured to receive a subtarget as an input 
and to generate vessel control signals as outputs, wherein the 
macronavigation system is configured to determine at least 
one subtarget based upon the target location and the pre- 
dicted sea state, and communicate at least one subtarget to 
the micronavigation system, and wherein the micronaviga- 
tion system is configured to generate vessel control signals 
that head a vessel toward at least one subtarget. 

In a yet further additional embodiment, a predicted sea 
state includes a main wave direction. 
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In a further additional again embodiment, a predicted sea 
state includes wave phase information. 

In another further embodiment again, a subtarget is a 
target location. 

In yet another further embodiment again, a micronaviga- 
tion system includes a proportional integral derivative con- 
troller. 

In a further embodiment, a macronavigation system is 
configured to cause a vessel to tack relative to a main wave 
direction. 

In yet a further embodiment, a macronavigation system is 
configured to determine at least one subtarget that causes 
vessel navigation at 60 degrees relative to a main wave 
direction 

In a yet further embodiment again, a micronavigation 
system is configured to generate vessel control signals 
configured to control the throttle and the rudder of a vessel. 

In another further embodiment yet again, a macronaviga- 
tion system is configured to receive a predicted sea state 
from a system for predicting a future sea state. 


BRIEF DESCRIPTION OF THE DRAWINGS 


FIG. 1 illustrates a system diagram of a sea state predic- 
tion and autonomous vessel navigation system in accordance 
with an embodiment of the invention. 

FIG. 2 is a flow chart illustrating a process for autono- 
mous vessel navigation involving the detection of wave 
fronts in accordance with an embodiment of the invention. 

FIG. 3 is a flow chart illustrating a process for detecting 
wave fronts from a 3D map of a current sea state in 
accordance with an embodiment of the invention. 

FIG. 4 is a flow chart illustrating a process for autono- 
mous vessel navigation using a target, main wave direction 
and wave phase prediction in accordance with an embodi- 
ment of the invention. 

FIG. 5 illustrates a control framework for an autonomous 
vessel navigation system utilizing a macronavigation system 
and a micronavigation system in accordance with an 
embodiment of the invention. 

FIG. 6 illustrates a control framework for a macronavi- 
gation system in accordance with an embodiment of the 
invention. 

FIG. 7 illustrates a determination of a subtarget from an 
appropriate point of sail given a target position and main 
wave direction in accordance with an embodiment of the 
invention. 

FIG. 8A illustrates experimental results for bow-diving as 
a function of the maximal point of sail for head seas in 
accordance with an embodiment of the invention. 

FIG. 8B illustrates experimental results for bow diving as 
a function of the maximal point of sail for following seas in 
accordance with an embodiment of the invention. 

FIG. 9A illustrates experimental results for a stand-alone 
PID controller compared to the PID controller configured to 
tack using a macronavigation system in accordance with an 
embodiment of the invention with bow diving as a function 
of the wave height H. 

FIG. 9B illustrates experimental results for a stand-alone 
PID controller compared to the PID controller configured to 
tack using a macronavigation system in accordance with an 
embodiment of the invention with time of travel T as a 
function of the target direction d. 

FIG. 10 illustrates the trajectories generated by an autono- 
mous navigation system that utilizes tacking to navigate to 
a target 100 meters away in 18 different directions in 
accordance with an embodiment of the invention. 
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FIG. 11 illustrates the difference between normalized 
heave response between vessel navigation with an autono- 
mous navigation system in accordance with an embodiment 
of the invention and one without the autonomous navigation 
system for a 13 meter high speed vessel operating at 35 
knots over a range of sea states. 


DETAILED DESCRIPTION 


Turning now to the drawings, systems and methods for 
automated vessel navigation using predictions of sea state 
conditions are illustrated. In various embodiments, sensors 
capture 3D maps of the sea surface. From the 3D maps, a 
model for the sea state is found from which sea state 
predictions are made. Sea state predictions can be made by 
detecting the peaks and troughs of waves from a noisy 
signal. Using the sea state predictions, a vessel can be 
autonomously navigated to minimize the forces experienced 
by the vessel and its crew associated with severe sea 
conditions. In this way, autonomous navigation systems in 
accordance with embodiments of the invention can improve 
the speed with which a vessel can reach a target in severe sea 
conditions, while reducing the likelihood of damage to the 
vessel and/or crew. In many embodiments, the autonomous 
navigation system utilizes a number of subtargets calculated 
based upon a main wave direction (derived from a predicted 
sea state) and a target location. The vessel speed, heading 
and load balancing state can be adjusted to reach the 
subtargets during the autonomous navigation. Thereby, uti- 
lizing only machine sensory input, a vessel can autono- 
mously navigate severe sea conditions in a way that limits 
the forces and/or damage experienced by the craft and crew. 

In many embodiments, autonomous sea surface naviga- 
tion utilizes 3D maps where features of the sea state are 
extracted. Sea state features include any potential hazards 
such as debris on the water or strong currents or waves on 
the sea surface. A sequence of 3D images of the sea surface 
can be analyzed to predict future sea states. Sea states can be 
determined by modeling the observed undulations in the sea 
surface as being caused by one or more propagating planar 
waves. In several embodiments, the sea state prediction 
involves locating peaks and troughs in a sequence of 3D 
images in order to the propagation of wavefronts. The 
wavefronts can then be used to estimate the amplitude, 
frequency and velocity of each observed propagating wave. 
In a number of embodiments, peaks and troughs of waves 
can be found through statistical methods that determine high 
and low points within a 3D map that can then be grouped to 
identify wavefronts. Once the amplitude, frequency and 
velocity of the waves are determined, predictions can be 
made concerning the sea state at a time in the future. In many 
embodiments, the sea state prediction is utilized to derive 
safe paths to a target that limit the forces experienced by the 
craft or crew. 

In several embodiments, autonomous navigation systems 
determine paths to a target utilizing navigation techniques 
including tacking by determining the vessel’s point of sail 
relative to wave direction (as opposed to wind direction). 
Tacking is a maneuver employed in sailing by which a vessel 
turns its bow through the wind so that the direction from 
which the wind blows changes from one side to the other. 
Sunilarly, for wave direction, tacking is a maneuver by 
which a vessel turns its bow through the wave so that the 
direction of the forward force of the wave changes from one 
side of the vessel to the other. Points of sail typically 
describe a sailing boat’s course in relation to the wind 
direction, such as by utilizing tacking to sail into the wind. 
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Using the points of sail analogy with respect to wave 
direction, the term point of sail is used here to describe the 
direction in which a vessel navigates relative to wave 
direction. In particular embodiments, an autonomous navi- 
gation system constantly updates the heading of the vessel in 
response to the dynamic nature of the sea surface. 

Systems and methods for performing sea state prediction 
and automated vessel navigation using sea state predictions 
in accordance with embodiments of the invention are dis- 
cussed further below. 

System Architecture 

Autonomous navigation systems in accordance with 
many embodiments of the invention include a system where 
sensors, processors and controllers function to predict a sea 
state and to provide navigation instructions to a vessel. FIG. 
1 illustrates a system diagram of a sea state prediction and 
autonomous vessel navigation system 100 in accordance 
with an embodiment of the invention. The system 100 
includes a radar sensor 102 and camera sensors 104. These 
sensors are connected to a sea state processor 106, vessel 
navigation processor 108 and vessel navigation controller(s) 
110 via a network 112. 

In the illustrated embodiment, the camera sensors (104) 
are configured as a stereo pair and can be utilized in 
combination with the radar sensor (102) to create a sequence 
of 3D images of the sea state. These 3D images of the sea 
state can be processed by a sea state processor to predict 
future sea states. In certain embodiments, the sea state 
processor can model the sea state for future predictions by 
detecting multiple wavefronts over time to estimate the 
amplitude, frequency and velocity of the wavefronts. In 
various embodiments, wavefronts are determined by detect- 
ing the peaks and troughs in a noisy signal through methods 
including (but not limited to) high and low point clusters on 
the 3D images of the sea state. The detection of wavefronts 
in accordance with embodiments of the invention is dis- 
cussed below. 

In the illustrated embodiment, the sea state prediction and 
autonomous vessel navigation system 100 navigates the 
vessel based upon the sea state predictions. In certain 
embodiments, information related to a main wave direction 
or wave phase is used to determine a tack plan or subtarget 
location as part of a navigation plan to reach a predetermined 
target. Vessel speed, heading and load balancing in view of 
the target can then be updated by the sea state prediction and 
autonomous vessel navigation system 100. 

In many embodiments, the system is implemented locally 
on a vessel or can utilize remote computing resources. The 
sensors can be any kind of sensor capable of producing 3D 
images of a sea surface. In addition, the sea state processor 
and vessel navigation processor can be implemented using 
the same physical computing system or on different proces- 
sors. Vessel navigation controllers can be any controller that 
is used to control vessel navigation. In many embodiments, 
the sea state prediction and autonomous vessel navigation 
system is implemented using a Control Architecture for 
Robotic Agent Command and Sensing (CARACaS) manu- 
factured by Spatial Integrated Systems, Inc. of Virginia 
Beach, Va. 

Processes related to a sea state prediction and autonomous 
vessel navigation in accordance with embodiments of the 
invention are discussed further below. 

Sea State Prediction and Autonomous Navigation 

As the sea surface changes, sea state predictions can be 
utilized to facilitate autonomous navigation to targets. FIG. 
2 is a flow chart illustrating a process 200 for performing sea 
state prediction for use in autonomous vessel navigation in 
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accordance with an embodiment of the invention. The 
process 200 begins by detecting (202) wave fronts in an 
initial 3D image. After detecting (202) initial wave fronts, 
the movement of the wave fronts can be tracked by detecting 
(204) wave fronts in subsequent 3D images. Based upon the 
location of wave fronts in the sequence of 3D images, the 
amplitude, frequency and velocity of the wavefronts can be 
estimated (206). After the characteristics of the observed 
waves are estimated (206), sea state predictions (208) can be 
made by modeling the propagation of the observed waves at 
a point of time in the future. Based upon the sea state 
prediction (208), the system can plan (210) a course toward 
a target destination. After the system begins to navigate 
(210) along the course to the target destination, a decision 
(212) is made as to whether the target has been reached. If 
the target is not yet reached, the system continues to collect 
information used to refine sea state predictions and to 
navigate to the target based upon the sea state predictions. If 
the target is already reached, then the process ends. 

In many embodiments, initial wave fronts are detected by 
determining peaks and troughs in a noisy signal thorough 
statistical analysis of high and low point clusters. The initial 
wave fronts can be observed by analyzing a single 3D map 
of a sea state or multiple 3D maps of a sea state captured 
from different perspectives and then fused or processed in a 
similar manner that exploits the redundancy in the images. 
Similar analysis can be utilized to detect wavefronts in 
subsequent 3D map(s) of the sea surface. 

In several embodiments, sea state predictions can be made 
based upon the expected behavior of multiple wave fronts 
modeled as planar waves. Tracking the waves from one 
image or 3D map of the sea surface to the next can enable 
the determination of the amplitude, frequency and velocity 
of the waves. Once these parameters are known for each 
wave, future sea states can be predicted. 

In a multitude of embodiments, navigation toward a target 
can be accomplished by navigating toward a subtarget 
dependent upon the sea state and the target location. The 
subtarget allows for vessel navigation to adapt to changing 
sea states. Autonomous navigation systems that utilize infor- 
mation obtained from sea state predictions in accordance 
with embodiments of the invention are discussed further 
below. Prior to discussing autonomous navigation systems, 
however, processes related to wave front detection in accor- 
dance with embodiments of the invention are discussed. 
Wave Front Detection 

Wave fronts can be detected by processing information 
from a 3D map of the sea surface. FIG. 3 is a flow chart 
illustrating a process 300 for detecting wave fronts from a 
3D map of the sea surface in accordance with an embodi- 
ment of the invention. The process 300 begins by obtaining 
(302) a 3D map of the sea surface. After obtaining (302) the 
3D map, peaks and troughs on the 3D map are detected (304) 
within the noisy signal. After detecting (304) the peaks and 
troughs, the wavefronts are then detected (306). 

A machine vision system can generate a sequence of 
images that can be used to generate a 3D map of how sea 
state changes over time. The system can use one or more 
stereo camera systems and the sensor data from the stereo 
camera systems can be combined with additional informa- 
tion from other types of sensors including but not limited to 
radar systems. Certain systems use two pairs of cameras to 
obtain stereo 3D images that are then fused. Several systems 
use black and white cameras, although color cameras or a 
combination of color and black and white can be used in 
other systems. In many embodiments, radar information is 
fused with information captured by stereo camera systems to 
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obtain better low light performance and to increase the range 
of the 3D map. In other embodiments, any of a variety of 
sensor systems that can generate 3D images can be utilized 
including but not limited to array cameras. 

In a variety of embodiments, peaks and troughs can be 
detected in a noisy signal through signal processing. A sea 
state detection system can take a sequence of 3D images of 
the sea surface over a short period of time. A sequence of 
high and low point clusters can be detected across the 3D 
images using a number of different processes including but 
not limited to the RANdom SAmple Consensus or 
RANSAC process, a least means square process, and/or 
thresholding. 

3D images of a sea surface generate a significant amount 
of noise as the water is dynamic and reflections in the water 
can be difficult for systems to handle. A number of methods 
can also be used to filter noise from the captured 3D images. 
The RANSAC process is an iterative method to estimate 
parameters of a model from a set of observed data, which 
contains outliers, or data that does not fit a model. RANSAC 
can be used to filter out noise through an assumption that 
given a set of inliers, there is a procedure which can estimate 
the parameters of a model that optimally explains or fits the 
data. The least means square (LMS) process finds the 
coefficients for a specific function that produces the least 
mean square of the error signal, or the difference between the 
desired and the actual signal. Thresholding is a process 
whereby peaks and troughs are identified based upon a value 
being above or below a specified threshold. Although spe- 
cific processes for detecting peaks and troughs are disclosed 
above, any of a variety of processes can be utilized in 
accordance with embodiments of the invention. 

In numerous embodiments, wavefronts can be detected by 
analyzing the peaks and troughs. Once the peaks and troughs 
are detected, then they can be grouped together to locate the 
wave fronts of planar waves on the water. The nearest 
neighbor algorithm can be used to identify wave fronts from 
clusters of peaks or clusters of troughs. The nearest neighbor 
algorithm classifies an object by a majority of its neighbors, 
with the object being assigned to the class most common 
amongst its nearest neighbors. In other embodiments, any of 
a variety of algorithms can be utilized to group peaks and 
troughs to identify wavefronts. 

Although specific processes are described above for 
detecting wavefronts within 3D images of a sea surface. Any 
of a variety of processes that are capable of detecting planar 
waves in sequences of captured 3D images can be utilized in 
accordance with embodiments of the invention. Once wave- 
fronts have been detected, a sea state prediction can be 
performed and a vessel can autonomously navigate relying 
upon the sea state prediction. Processes related to autono- 
mous vessel navigation in accordance with embodiments of 
the invention are discussed further below. 

Autonomous Vessel Navigation 

Autonomous vessel navigation systems can utilize sea 
state predictions to improve system performance in any of a 
number of ways including (but not limited to) attempting to 
limit the forces experienced by a vessel and/or its crew in 
severe sea states. In many embodiments, the sea state may 
be sufficiently severe as to warrant navigating to avoid 
waves as opposed directly toward a target. FIG. 4 is a flow 
chart illustrating a process 400 for autonomous vessel navi- 
gation using a target, and main wave direction in accordance 
with an embodiment of the invention. The process 400 
begins by determining (402) the main wave direction from 
the predicted sea state. After determining (402) the main 
wave direction, a path to the target is developed (404). In 
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several embodiments, planning the path to the target can 
utilize the predicted phase of the main wave obtained using 
a sea state prediction to time turns relative to the phase of the 
wave. After determining (404) a path to the target, a sub- 
target is determined (406) and the vessel speed, heading and 
load balancing are updated (408) to steer the vessel toward 
the subtarget. Autonomous vessel navigation systems in 
accordance with embodiments of the invention are discussed 
further below. 

Autonomous Navigation Control Framework 

Autonomous vessel navigation can be facilitated using a 
control framework. FIG. 5 illustrates a control framework 
500 for autonomous vessel navigation utilizing a macro- 
navigation system and a micronavigation system from target 
and sensory information in accordance with an embodiment 
of the invention. In the control framework, both the target 
502 and sensor 504 feeds into the macronavigation system 
506. The macronavigation system 506 feeds into the micro- 
navigation system 508, which can be a proportional-inte- 
gral-derivative controller (PID controller). In the illustrated 
embodiment, the micronavigation system 508 feeds into 
both the throttle 510 and the rudder 512 of the vessel. The 
status of the throttle 510 and rudder 512 of the vessel effects 
a sea state prediction or real world conditions 514. The sea 
state prediction or the real world conditions 514 then affects 
the target 502 and the sensor 504. 

In many embodiments, macronavigation processes deter- 
mine the way autonomous navigation occurs while micro- 
navigation processes determine how the autonomous navi- 
gation strategy should be implemented. Both the target and 
the sensory data are used by the macronavigation system to 
plot the best navigable path to the target given the observed 
sea state (obtained using the sensor system). In certain 
embodiments, the macronavigation system masks the target 
position and calculates subtargets that are provided to the 
micronavigation system so that the vessel does not head 
directly toward the actual target. In this way, the macronavi- 
gation system can implement tacks and/or other maneuvers 
that can limit the forces experienced by the vessel and its 
crew. The micronavigation controls the throttle and rudder 
of the vessel to head the vessel toward the target or subtarget 
provided to the micronavigation system by the macronavi- 
gation system. After the throttle and rudder states are 
updated, new sea state predictions can be used by the 
autonomous navigation system to update the path the vessel 
takes to the target. 

In certain embodiments, for reliable target reaching, a PID 
control approach is used by the micronavigation system. A 
PID controller is a generic control loop feedback mechanism 
that calculates an “error” value as the difference between a 
measured process variable and a desired set point. The 
controller attempts to minimize the error by adjusting the 
process control input. In many embodiments, the PID con- 
troller drives the throttle strength and position based on the 
current target (or subtarget) position provided to the micro- 
navigation system relative to the vessel. The throttle strength 
is proportional to the absolute target distance, and the rudder 
command is proportional to the target direction. In calcula- 
tions for particular embodiments, t(t)=(x,y) is the target 
position and p(t) is the current vessel position in world 
coordinates at time t. Then, the control deviation is c(t)=t 
(t)-p(t). The control deviation is translated into command 
signals according to the following equation for the throttle 
strength: 
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The control deviation is translated into command signals 
according to the following equation for the rudder position, 
where e,, is the control deviation that points sideways to 
starboard along the y-axis of the vessel according to the 
coordinate system as seen by the vessel: 


r(O=P,e,(O+1Jo'e,()dt'+D,le,()-e,(t-1)| 


Targets behind the vessel require a tum of the vessel. This 
can easily be achieved by multiplying throttle and rudder 
commands with sgn(e,(t) and with sgn(c,(t)), respectively. 
In a number of embodiments, the following gain constants 
can be used: P=0.03; 1=D=P,=0.02, I,=0 and D,=0.01. The 
throttle and rudder commands can be restricted to a reason- 
able range by clipping their values to [-0.25, 0.7] and [-0.4, 
0.4]. In other embodiments, any of a variety of micronavi- 
gation systems can be utilized including PID control systems 
that incorporate alternative parameters and/or constraints. 

As discussed above, the subtargets utilized by micronavi- 
gation systems are generated by macronavigation systems in 
accordance with embodiments of the invention. FIG. 6 
illustrates a control framework 600 for macronavigation in 
accordance with an embodiment of the invention. In the 
control framework 600, a target 502 is used to determine 
(610) the direction from the vessel to the target. The target 
is also provided to a navigation planner 612. Sensor data 504 
is used to determine (614) a main wave direction. In many 
embodiments, the main wave direction can be determined 
using a sea state prediction process similar to any of the sea 
state prediction processes outlined above. The difference 
between the target direction 610 and the main wave direction 
614 determines (616) the point of sail of the vessel relative 
to the main wave. The point of sail is fed into the navigation 
planner 612, which generates a subtarget that is provided to 
the micronavigation system 508. As is discussed further 
below, the macronavigation system illustrated in FIG. 6 can 
be utilized to incorporate tack planning into a macronavi- 
gation process in accordance with embodiments of the 
invention. 

Tack Planning 

In several embodiments, tacking behavior constrains ves- 
sel motion to minimize the effects of severe sea conditions, 
such as bow diving. Bow diving is when a vessel’s bow is 
submerged due to either the motion of the boat or the sea 
surface. In many embodiments, tack planning is used to 
determine subtargets in autonomous vessel navigation to 
limit the forces that are experienced by the vessel and/or 
crew as it navigates toward a target. 

Referring back to the macronaviagtion system illustrated 
in FIG. 6, knowledge about the point of sail (POS) necessary 
to reach a target is an important part of implementing a tack 
planner. In certain embodiments, the POS is calculated 
depending on the target direction (TD) and the main wave 
direction (MWD) by POS=TD-MWD. Thus, a prerequisite 
for the planner is the estimation of the MWD. While 
derivation of the target direction from the target position is 
straightforward, the main wave direction is extracted from 
sensory information. 

Macronavigation systems in accordance with many 
embodiments of the invention tack at certain angles to 
minimize bow diving. FIG. 7 illustrates a determination of 
a subtarget from an appropriate point of sail given a target 
position and main wave direction in accordance with an 
embodiment of the invention. In the illustrated embodiment, 
when the point of sail necessary to reach the target is too 
steep with respect to the main wave direction, the planner 
determines that a subtarget that is the projection of the 
original target onto the appropriate point of sail. 
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FIG. 8A illustrates experimental results for bow diving as 
a function of the maximal point of sail for head seas in 
accordance with an embodiment of the invention. Likewise, 
FIG. 8B illustrates experimental results for bow diving as a 
function of the maximal point of sail for following seas in 
accordance with an embodiment of the invention. As illus- 
trated in both FIGS. 8A and 8B, bow diving is significantly 
reduced around a tack of 60 degrees in both head and 
following seas. Thereby in certain embodiments, tack plan- 
ning can take advantage of tacking at around 60 degrees. 

Generally, points of sail in parallel or antiparallel to the 
MWD result in considerable bow diving. The navigation 
planner creates subtargets for tacks according to a safe point 
of sail p,,,, when the point of sail p necessary to reach a 
target falls into one of the following ranges: 
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A subtarget is created that is the projection of the original 
target onto the adopted point of sail p,,,. In doing so, the 
navigation planner transfers the direct path to the target into 
a tacked path that circumvents extreme points of sail with 
the risk of bow diving. In various embodiments, the concept 


of subtarget generation is illustrated in FIG. 7. Certain 
embodiments yield ideal values for p,,.."°"" and py?” 


where pyran? Pinal ?”=60 degrees. Therefore, certain 


embodiments use a 60 degree margin around head and 
following seas. In other embodiments, a greater or lesser 
margin can be used as appropriate to specific applications. 

FIG. 9A illustrates experimental results for a stand-alone 
PID controller compared to a TPID-Controller that is con- 
trolled by a macronavigation system that implements tack- 
ing the manner outlined above with bow diving as a function 
of the wave height H in accordance with an embodiment of 
the invention. FIG. 9B illustrates experimental results for a 
stand-alone PID controller compared to a TPID-Controller 
that is controlled by a macronavigation system that imple- 
ments tacking the manner outlined above with time of travel 
T as a function of the target direction d in accordance with 
an embodiment of the invention. Experimental results for 
FIGS. 9A and 9B were generalized for wave heights H from 
0 meters to 3 meters. 

FIG. 9A illustrates how the addition of the tack planner in 
certain embodiments significantly improves the perfor- 
mance with respect to bow diving. However, for small wave 
heights certain embodiments favor not utilizing tacking as 
embodiments that tack dive more often with the bow than a 
stand-alone microcontroller. This is due to the increased 
travel distance, which consequently results in an increased 
number of wave crests to pass. The extra time of travel 
caused by the increased travel distance due to the tacks is 
revealed in FIG. 9B. But the increased time of travel is rather 
moderate and worth investing for the security gained by the 
tack planner. In numerous embodiments, tacking and the 
appropriate tack angles pe and tae are selected 
depending on the current sea state. In particular embodi- 
ments in the case of a calm sea state, tacking is not necessary 
and Pir as well as Pont evew can be set to zero. However, 
bow diving is significantly reduced for severe sea condi- 
tions. Moreover, FIG. 9B indicates how bow diving depends 
on the relation of the vessel’s length and the wave length. 
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Thereby in certain embodiments only for a specific region 
around a wave height of 1.6 m, the vessel dives considerably 
with the bow into the water. For these wave heights, shallow 
water can yield wave lengths similar to the vessel’s length. 

FIG. 10 illustrates the trajectories generated by an autono- 
mous navigation system that utilizes tacking in the manner 
outlined above to navigate to a target 100 meters away in 18 
different directions in accordance with an embodiment of the 
invention. Grey areas (700) indicate the occurrence of bow 
diving. In the illustrated embodiment, trajectories generated 
by the autonomous navigation system generate tacks that 
avoid heading and following seas. The PID controller suc- 
ceeds also in the planning condition to steer the vessel to the 
desired targets. In certain embodiments, bow diving does not 
occur as frequently as for the stand-alone PID controller. In 
a number of embodiments, tack planning generates a tack- 
trigger mechanism that triggers turning depending on the 
wave phase. 

In numerous embodiments, autonomous navigation sys- 
tems integrate adaptive planning and control that can be 
simulated, for example with hardware in the loop (HWIL) 
developed by the Jet Propulsion Laboratory headquartered 
in Pasadena, Calif. HWIL simulation is a technique used in 
the development and testing of complex real time embedded 
systems utilizing mathematical representations for each 
dynamic system. FIG. 11 illustrates the difference between 
normalized heave response between vessel navigation with 
an autonomous navigation system in accordance with an 
embodiment of the invention and one without the autono- 
mous navigation system for a 13 meter high speed vessel 
operating at 35 knots over a range of sea states as simulated 
in a HWIL. In the illustrated embodiment, heave responses 
are generally minimized with adaptive path planning and 
control relative to systems without adaptive path planning 
and control. 

While the above description contains many specific 
embodiments of the invention, these should not be construed 
as limitations on the scope of the invention, but rather as an 
example of one embodiment thereof. 


What is claimed is: 

1. A method of predicting a future sea state comprising: 

generating a sequence of at least two 3D images of a sea 
surface using at least two image sensors; 

detecting peaks and troughs in the 3D images using a 
processor; 

identifying at least one wavefront in each 3D image based 
upon the detected peaks and troughs using the proces- 
sor; 

determining an amplitude, frequency, and velocity of the 
at least one wavefront by tracking the at least one 
wavefront in the sequence of at least two 3D images 
using the processor; 

characterizing at least one propagating wave based upon 
the amplitude, frequency, and velocity of the at least 
one wavefront detected in the sequence of 3D images 
using the processor; 

predicting a future sea state using the at least one propa- 
gating wave based upon the amplitude, frequency, and 
velocity characterizing the at least one wavefront in the 
sequence of 3D images using the processor; and 

autonomously navigating a vessel using the future sea 
state. 

2. The method of claim 1, wherein generating a sequence 

of at least two 3D images of a sea surface uses two pairs of 
image sensors. 
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3. The method of claim 1, wherein generating a sequence 
of at least two 3D images of a sea surface also includes using 
a radar sensor in combination with the at least two image 
sensors. 

4. The method of claim 1, wherein the images sensors 
capture black and white images. 

5. The method of claim 1, wherein the image sensors 
capture color images. 

6. The method of claim 1, wherein detecting peaks and 
troughs comprises using a random sampling process. 

7. The method of claim 1, wherein detecting peaks and 
troughs comprises using a least means squares process. 

8. The method of claim 1, wherein detecting peaks and 
troughs comprises using a thresholding process. 

9. The method of claim 1, wherein identifying at least one 
wavefront comprises using a nearest neighbor process. 

10. The method of claim 1, wherein characterizing at least 
one propagating wave comprises determining the direction 
of the at least one propagating wave. 

11. The method of claim 1, wherein characterizing at least 
one propagating wave comprises determining the wave 
phase of the at least one propagating wave. 

12. The method of claim 1, further comprising autono- 
mously navigating a vessel based upon the predicted future 
sea state. 

13. A system for predicting a future sea state comprising: 

a sensor system configured to capture information con- 

cerning the shape of the sea surface; 

a sea state processor configured to communicate with the 

sensor system; 

wherein the sensor system and the sea state processor are 

configured so that the captured information is used to 

generate a sequence of 3D images of a sea surface; 

wherein the sea state processor is configured to: 

detect peaks and troughs in the 3D images; 

identify at least one wavefront in each 3D image based 
upon the detected peaks and troughs; 

determine an amplitude, frequency, and velocity of the 
at least one wavefront by tracking the at least one 
wavefront in the sequence of 3D images; 

characterize at least one propagating wave based upon 
the amplitude, frequency, and velocity of the at least 
one wavefront detected in the sequence of 3D images 
using the processor; 
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predict a future sea state using the at least one propa- 
gating wave based upon the amplitude, frequency, 
and velocity characterizing the at least one wavefront 
in the sequence of 3D images using the processor; 
and 

autonomously navigate a vessel using the future sea 
state. 

14. The system of claim 13, wherein the sensor system 
comprises two pairs of image sensors. 

15. The system of claim 13, wherein the sensor system 
comprises a radar sensor. 

16. The system of claim 13, wherein the sensor system 
and the sea state processor are configured so that the 
captured information is used to generate a sequence of black 
and white 3D images of a sea surface. 

17. The system of claim 13, wherein the sensor system 
and the sea state processor are configured so that the 
captured information is used to generate a sequence of color 
3D images of a sea surface. 

18. The system of claim 13, wherein the sea state pro- 
cessor is configured to detect peaks and troughs using a 
random sampling process. 

19. The system of claim 13, wherein the sea state pro- 
cessor is configured to detect peaks and troughs using a least 
means squares process. 

20. The system of claim 13, wherein the sea state pro- 
cessor is configured to detect peaks and troughs using a 
thresholding process. 

21. The system of claim 13, wherein the sea state pro- 
cessor is configured to identify the at least one wavefront 
using a nearest neighbor process. 

22. The system of claim 13, wherein the sea state pro- 
cessor is configured to characterize the at least one propa- 
gating wave by the direction of the at least one propagating 
wave. 

23. The system of claim 13, wherein the sea state pro- 
cessor is configured to characterize the at least one propa- 
gating wave by the wave phase of the at least one propa- 
gating wave. 

24. The system of claim 13, further comprising an autono- 
mous vessel navigation system that utilizes the predicted 
future sea state to determine vessel heading when navigating 
toward a target. 


